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Abstract 

A watershed in systems engineering is represented by 
the advent of swarm-based systems that accomplish mis- 
sions through cooperative action by a (large) group of au- 
tonomous individuals each having simple capabilities and 
no global knowledge of the group's objective . Such systems , 
with individuals capable of surviving in hostile environ- 
ments , pose unprecedented challenges to system develop- 
ers. Design and testing and verification at much higher lev- 
els will be required [ together with the corresponding tools , 
to bring such systems to fruition. Concepts for possible fu- 
ture NASA space exploration missions include autonomous, 
autonomic swarms. Engineering swarm-based missions be- 
gins with understanding autonomy and autonomicity and 
how to design , test , and verify systems that have those prop- 
erties and, simultaneously , the capability to accomplish pre- 
scribed mission goals. Formal methods-based technologies, 
both projected and in development, are described in terms 
of their potential utility to swarm-based system developers . 


1. Introduction 

We are all familiar with swarms in nature. The mere 
mention of the word “swarm” conjures up images of large 
groupings of small insects, such as bees (apiidae) or locusts 
(acridiidae), each insect having a simple role, but with the 
swarm as a whole producing complex behavior. 

Strictly speaking, such emergence of complex behavior 
is not limited to swarms, and we see similar complex social 
structures occurring with higher order animals and insects 
that don’t swarm per se: colonies of ants, flocks of birds, 


packs of wolves, etc. These groupings behave like swarms 
in many ways. With wolves, for example, the elder male and 
female (alpha male and alpha female) are accepted as lead- 
ers who communicate with the pack via body language and 
facial expressions. Moreover, the alpha male marks the ter- 
ritory of the pack, and excludes wolves that are not mem- 
bers of the pack. 

The idea that swarms can he used to solve complex prob- 
lems has been taken up in several areas of computer sci- 
ence, which we will briefly introduce in Section 2. The term 
“swarm” in this paper refers to a large grouping of simple 
components working together to achieve some goal and pro- 
duce significant results. The term should not be taken to im- 
ply that these components fly (or are airborne); they may 
equally well be on the surface of the Earth, under the sur- 
face, under water, or indeed operating on other planets. 

We will describe NASA’s motivation for using swarms 
in future exploration missions. We will describe one par- 
ticular mission, currently in the concept stage, and exam- 
ine why this (and similar systems) must exhibit autonomic 
properties. 

2. Swarms and Intelligence 

Swarms consist of a large number of simple entities that 
have local interactions (including interactions with the en- 
vironment) [2]. The result of the combination of simple 
behaviors (the microscopic behavior) is the emergence of 
complex behavior (the macroscopic behavior) and the abil- 
ity to achieve significant results as a “team” [4]. 

Intelligent swarm technology is based on swarm tech- 
nology where the individual members of the swarm also ex- 
hibit independent intelligence [3]. With intelligent swarms, 


members of the swarm may be heterogeneous or homoge- 
neous. Even if members start as homogeneous, due to their 
differing environments they may learn different things, de- 
velop different goals, and therefore become a heterogeneous 
swarm. Intelligent swarms may also be made up of hetero- 
geneous elements from the outset, reflecting different capa- 
bilities as well as a possible social structure. 

Agent swarms are being used as a computer modeling 
technique and have also been used as a tool to study com- 
plex systems [12]. Examples of simulations that have been 
undertaken include swarms of birds [5, 16], as well as busi- 
ness and economics [15] and ecological systems [20]. 

In swarm simulations , each of the agents is given cer- 
tain parameters that it tries to maximize. In terms of bird 
swarms, each bird tries to find another bird to fly with, 
and then flies off to one side and slightly higher to reduce 
its drag. Eventually the birds form flocks. Other types of 
swarm simulations have been developed that exhibit un- 
likely emergent behavior. These emergent behaviors are the 
sums of often simple individual behaviors, but, when ag- 
gregated, form complex and often unexpected behaviors. 
Swarm behavior is also being investigated for use in such 
applications as telephone switching, network routing, data 
categorizing, and shortest path optimizations. 

Swarm intelligence techniques (note the slight dif- 
ference in terminology from “intelligent swarms”) are 
population-based stochastic methods used in combinato- 
rial optimization problems, where the collective behavior 
of relatively simple individuals arises from their local inter- 
actions with their environment to give rise to the emergence 
of functional global patterns. Swarm intelligence repre- 
sents a metaheuristic approach to solving a wide variety of 
problems. 

Swarm robotics refers to the application of swarm intel- 
ligence techniques to the analysis of swarms where the em- 
bodiment of the “agents” is as physical robotic devices. 

3. NASA Swarm Technologies 

Future NASA missions will exploit new paradigms for 
space exploration, heavily focused on the (still) emerg- 
ing technologies of autonomous and autonomic sys- 
tems [25, 26]. Traditional mission concepts, reliant on 
one large spacecraft, are being complemented with mis- 
sion concepts that involve several smaller spacecraft, op- 
erating in collaboration, analogous to swarms in nature. 
This offers several advantages: the ability to send space- 
craft to explore regions of space where traditional craft 
simply would be impractical, greater redundancy (and, con- 
sequently, greater protection of assets), and reduced costs 
and risk, to name but a few. Planned missions entail the 
use of several unmanned autonomous vehicles (UAVs) fly- 
ing approximately one meter above the surface of Mars, 


which will cover as much of the surface of Mars in three 
seconds as the now famous Mars rovers did in their en- 
tire time on the planet; the use of armies of tetrahedral 
walkers to explore the Martian and Lunar surface; con- 
stellations of satellites flying in formation; and the use 
of miniaturized pico-class spacecraft to explore the aster- 
oid belt. 

These new approaches to exploration missions simulta- 
neously pose many challenges. The missions will be un- 
manned and necessarily highly autonomous. They will also 
exhibit the classic properties of autonomic systems, be- 
ing self-protecting, self-healing, self-configuring, and self- 
optimizing. Many of these missions will be sent to parts 
of the solar system where manned missions are simply not 
possible, and to where the round-trip delay for communi- 
cations to spacecraft exceeds 40 minutes, meaning that the 
decisions on responses to problems and undesirable situa- 
tions must be made in situ rather than from ground control 
on Earth. The degree of autonomy that such missions will 
possess would require a prohibitive amount of testing in or- 
der to accomplish system verification. Furthermore, learn- 
ing and adaptation towards continual improvements in per- 
formance will mean that emergent behavior patterns simply 
cannot be fully predicted through the use of traditional sys- 
tem development methods. The result is that formal spec- 
ification techniques and formal verification will play vital 
roles in the future development of NASA space exploration 
missions. 

3.1. ANTS: A Concept Mission 

Automomous Nano Technology Swarm (ANTS) is a 
joint NASA Goddard Space Right Center and NASA Lang- 
ley Research Center collaboration to develop revolutionary 
mission architectures and exploit artificial intelligence tech- 
niques and paradigms in future space exploration. The mis- 
sion will make use of swarm technologies for both space- 
craft and surface-based rovers. 

ANTS consists of a number of concept missions: 

SARA: The Saturn Autonomous Ring Array will launch 
1000 pico-class spacecraft, organized as ten sub- 
swarms, each with specialized instruments, to perform 
in situ exploration of Saturn’s rings, by which to un- 
derstand their constitution and how they were formed. 
The concept mission will require self-configuring 
structures for nuclear propulsion and control, which 
lies beyond the scope of this paper. Additionally, au- 
tonomous operation is necessary for both maneu- 
vering around Saturn’s rings and collision avoid- 
ance. 

PAM : Prospecting Asteroid Mission will also launch 1000 
pico-class spacecraft, but here with the aim of explor- 
ing the asteroid belt and collecting data on particular 



asteroids of interest. PAM is described below in Sec- 
tion 3.1.1. 

LARA: ANTS Application Lunar Base Activities will ex- 
ploit new NASA-developed technologies in the field of 
miniaturized robotics, which may form the basis of re- 
mote landers to be launched to the moon from remote 
sites, and may exploit innovative techniques (described 
below in Section 3.1.2) to allow rovers to move in an 
amoeboid-like fashion over the moon’s uneven terrain. 

Since SARA and PAM have many issues in common 
(as regards autonomous operation), we will concentrate on 
PAM in the following. Section 3.1.2 describes the unique 
technologies that are planned for the LARA (and other) con- 
cept missions. 

3-1.1. PAM The ANTS PAM (Prospecting Asteroid Mis- 
sion) concept mission [8, 9, 25, 26] will involve the launch 
of a swarm of autonomous pico-class (approximately 1kg) 
spacecraft that will explore the asteroid belt for asteroids 
with certain characteristics. 

Figure 1 gives an overview of the PAM mission con- 
cept [25]. In this mission, a transport ship, launched from 
Earth, will travel to a point in space where gravitational 
forces on small objects (such as pico-class spacecraft) are 
all but negligible. From this point, termed a Lagrangian, 
1000 spacecraft, which will have been assembled en route 
from Earth, will be launched into the asteroid belt. As much 
as 60 io 70 percent of ihein are expected to be lost during the 
mission, primarily because of collisions with each other or 
with an asteroid during exploration operations, since, hav- 
ing only solar sails to provide thrust, their ability to ma- 
neuver will be severely limited. Because of their small size, 
each spacecraft will carry just one specialized instrument 
for collecting a specific type of data from asteroids in the 
belt. Approximately 80 percent of the spacecraft will be 
workers that will carry the specialized instruments (e.g., a 
magnetometer or an x-ray, gamma-ray, visible/IR, or neutral 
mass spectrometer) and will obtain specific types of data. 
Some will be coordinators (called leaders) that have rules 
that decide the types of asteroids and data the mission is in- 
terested in and that will coordinate the efforts of the work- 
ers. The third type of spacecraft are messengers that will 
coordinate communication between the rulers and workers, 
and communications with the Earth ground station. 

The swarm will form sub-swarms under the control of a 
ruler, which contains models of the types of science that it 
wants to perform. The ruler will coordinate workers, each of 
which uses its individual instrument to collect data on spe- 
cific asteroids and feed this information back to the ruler, 
who will determine which asteroids are worth examining 
further. If the data matches the profile of a type of aster- 
oid that is of interest, an imaging spacecraft will be sent to 
the asteroid to ascertain the exact location and to create a 



Figure 1. NASA’s Autonomous Nano Technol- 
ogy Swarm (ANTS) mission scenario. 


rough model to be used by other spacecraft for maneuver- 
ing around the asteroid. Other teams of spacecraft will then 
coordinate to finish mapping the asteroid to form a com- 
plete model. 

3.1.2. SMART The ANTS SMART (Super Miniatur- 
ized Addressable Reconfigurable Technology) architec- 
tures were initiated at Goddard Space Flight Center (GSFC) 
to develop new kinds of structures capable of: 

• goal-oriented robotic motion, 

• changing form to optimize function (morphological 
capabilities), 

• adapting to new environmental demands (learning and 
adaptation capabilities), and 

• repairing-protecting itself (autonomic capabilities). 

The basic unit of the structures is a tetrahedron (Fig- 
ure 2) consisting of four addressable nodes interconnected 
with six stmts that can be reversibly deployed or stowed. 
More complex structures are formed from interconnecting 
these reconfigurable tetrahedra, making structures that are 
scalable, and leading to massively parallel systems. These 
highly-integrated 3-dimensional meshes of actuators/nodes 
and structural elements hold the promise of providing a new 
approach to robust and effective robotic motion. The cur- 
rent working hypothesis is that the full functionality of such 
a complex system requires fully autonomous intelligent op- 
erations at each node. 

The tetrahedron (tet) “walks” by extending certain struts, 
changing its center of mass and “falling” in the desired di- 
rection. As the tetrahedral structure “grows” by interfac- 
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Figure 2. Basic unit of tetrahedral structures. 


ing more and more tets, the failing motion evolves to a 
smoother walking capability, i.e., the smoother walking- 
climbing-avoiding capabilities emerge from the orchestra- 
tion of the capabilities of the tetrahedra involved in the com- 
plex structure. 

Currently, the basic structure, the tetrahedron, is being 
modeled as a communicating and cooperating/collaborating 
four-agent system with an agent associated with each node 
of the tetrahedon. An agent, in this context, is an intelli- 
gent autonomous process capable of bi-level deliberative 
and reactive behaviors with an intervening neural inter- 
connection (the structure of the neural basis function [7]). 
The node agents also possess social and introspective be- 
haviors. The problem to be solved is to scale this model 
up to one capable of supporting autonomous operation 
for a 12-tet rover (a structure realized by the integration 
of 12 tets in a polyhedral structure). The overall objec- 
tive is to achieve autonomous robotic motion of this struc- 
ture. (See http://ants.gsfc.nasa.gov to view animations of 
the tetrahedon-based walking capabilities currently being 
modeled as multi-agent systems.) 

3.2. Other NASA Swarm-Based Missions 

An autonomous space exploration system is currently 
under development at Virginia Tech, funded by the NASA 
Institute for Advanced Concepts (NIAC). 

The system consists of a swarm of low altitude, 
buoyancy-driven gliders for terrain exploration and sam- 
pling, a buoyant oscillating wing that absorbs wind energy, 
and a docking station that can be used to anchor the en- 
ergy absorber, charge the gliders, and serve as a communi- 
cations relay. 

The work builds on success with underwater gliders cur- 
rently used for oceanography research. The intent is to de- 
velop low-cost planetary exploration systems that can run 
autonomously for years in harsh environments such as in the 


sulfuric acid atmosphere of Venus, or on Titan (the largest 
of Saturn’s moons). 

3.3. NASA Constellations 

We may consider constellations — several spacecraft fly- 
ing together in formation — to be a special case of swarms. 

The ST5 mission, for example, which is scheduled for 
Spring 2006, will launch three identical spacecraft that will 
fly in a “string of pearls” formation, utilizing a single up- 
link/downlink to earth. While a mission based on three 
spacecraft cannot be expected to perform highly distributed 
work as envisaged in ANTS, for example, it is certainly pos- 
sible for the large spacecraft (or satellites) to be used in a 
constellation. 

Indeed, this is the approach taken in the NASA 
Constellation-X mission. Constellation-X involves the use 
of a small number of telescopes (currently four), in forma- 
tion and working together to give the equivalent of a sin- 
gle X-ray telescope for observing black holes and other 
X-ray sources with greater resolution than before possi- 
ble. 

4. Other Applications of Swarms 

The behavior of swarms of bees has been studied as part 
of the BioTracking project at Georgia Tech [1]. To expedite 
ihe understanding of the behavior of bees where large scale 
robust behavior emerges from the simple behavior of indi- 
viduals, the project videotaped the behavior of bees over a 
period of time, using a computer vision system to analyze 
data on sequential movements that bees use to encode the 
location of supplies of food, etc. The intention is that such 
models of bee behavior can be used to improve the orga- 
nization of cooperating teams of simple robots capable of 
complex operations. A key point is that the robots need not 
have a priori knowledge of the environment, nor is there di- 
rect communication between robots in the teams. 

Research at Penn State University has focused on the use 
of particle swarms for the development of quantitative struc- 
ture activity relationships (QSAR) models used in the area 
of drug design [6]. The research created models using arti- 
ficial neural networks and k-nearest neighbor and kernel re- 
gression. Binary and niching particle swarms were used to 
solve feature selection and feature weighting problems. 

Particle swarms have influenced the field of computer an- 
imation also. Rather than scripting the path of each individ- 
ual bird in a flock, the Boids project [16] elaborates a parti- 
cle swarm with the simulated birds being the particles. The 
aggregate motion of the simulated flock is much like that 
in nature: it is the result of the dense interaction of the rel- 
atively simple behaviors of each of the (simulated) birds, 
where each bird chooses its own path. 


Much success has been reported from the use of Ant 
Colony Optimization, a technique that studies the social be- 
haviors of colonies of ants, and uses these behavior patterns 
as models for solving difficult combinational optimization 
problems [11]. The study of ants and their ability to find 
shortest paths has lead to ACO solutions to the traveling 
salesman problem, as well as network and internet opti- 
mizations [10, 11]. 

Work at University of California Berkeley is focusing 
on the use of networks of Unmanned Underwater Vehi- 
cles (UUVs). Each UUV has the same template informa- 
tion, containing plans, subplans, etc., and relies upon this 
and its own local situation map to make independent deci- 
sions, which will result in cooperation between all of the 
UUVs in the network. Experiments involving strategies for 
group pursuit will be conducted in a shallow water pool. 

5. Swarm Technologies Require Autonomicity 

5.1. Autonomic Properties of ANTS 

The ANTS mission will exhibit almost total autonomy. 
The mission will also exhibit many of the properties re- 
quired to qualify it as an autonomic system [21, 26, 27]. 

Self-Configuring: ANTS’ resources must be fully config- 
urable to support concurrent exploration and examina- 
tion of hundreds of asteroids. Resources must be con- 
figured at both the swarm and team (sub-swarm) lev- 
els, in order to coordinate science operations while si- 
multaneously maximizing resource utilization. 

Self-Optimizing: Rulers self-optimize primarily through 
learning and improving their ability to identify aster- 
oids that will be of interest. Messengers self-optimize 
through positioning themselves appropriately. Workers 
self-optimize through learning and experience. Self- 
optimization at the system level propagates up from 
the self-optimization of individuals. 

Self-Healing: ANTS must self-heal to recover from dam- 
age due either to solar storms or (possibly) to collision 
with an asteroid or other ANTS spacecraft. Loss of a 
ruler or messenger may involve a worker being “up- 
graded” to fulfill that role. Additionally, loss of power 
may require a worker to be killed off. 

Self-Protecting: In addition to protection from collision 
with asteroids and other spacecraft, ANTS teams must 
protect themselves from solar storms, where charged 
particles can degrade sensors and electronic compo- 
nents, and destroy solar sails (the ANTS spacecrafts’ 
sole source of power and thrust). ANTS teams must 
re-plan their trajectories, or, in worst-case scenarios, 
must go into “sleep” mode to protect their sails and in- 
struments and other subsystems. 


The concept of autonomicity can be further elaborated 
beyond the self-CHOP properties listed above. Three ad- 
ditional self-properties: self-awareness, self-monitoring 
and self-adjusting, will facilitate the basic self-properties. 
Swarm (ANTS) individuals must be aware (have knowl- 
edge) of their own capabilities and their limitations, 
and the workers, messengers, and rulers will all be in- 
volved in constant self-monitoring and (if necessary) 
self-adjusting, thus forming a feedback control loop. Fi- 
nally, further elaborated, the concept of autonomicity would 
require environmental awareness: the swarm (ANTS) in- 
dividuals will need to be constantly aware of the environ- 
ment around them not only to ensure mission success but 
also to self-CHOP and adapt when necessary. 

5.2. Why Other Swarm Based Systems Should be 
Autonomic 

We have argued elsewhere [22] that all computer based 
systems should be autonomic. We can certainly justify this 
in the case of most NASA missions, due to the high levels 
of autonomy, the difficulties of dealing with reduced com- 
munication bandwidth while at the same time responding 
rapidly to situations that threaten the mission, and the re- 
moteness of the operation. 

Swarms are being used in devising solutions to various 
problems principally because they present an appropriate 
model for that problem. We have described in Section 3.1 
and Section 4 several application areas of swarm technol- 
ogy where the approach seems to be particularly success- 
ful. 

But swarms (in nature or otherwise) inherently need 
to exhibit autonomic properties. To begin with, swarms 
should be self directed and self governing. Recall that this is 
achieved through the complex behavior that emerges from 
the combination of several simple behaviors and their inter- 
action with the environment. It can be said that in nature, 
organisms and groups/colonies of individuals, with the one 
fundamental goal of survival, would succumb as individu- 
als and even as species without autonomicity. The conclu- 
sion that invented swarms with planned mission objectives 
must similarly possess autonomicity is inescapable. 

5.3. Verifying Swarms 

As mission software becomes more complex, testing and 
error-finding also become more difficult. This is especially 
true of highly parallel processes and distributed computing, 
both being characteristic of swarm-based systems. 

Race conditions in these systems can rarely be found by 
inputting sample data and checking whether the results are 
correct. These types of errors are time-based and only occur 
when processes send or receive data at particular times, or in 


a particular sequence, or after learning occurs. To find these 
errors through testing, the software processes involved have 
to be executed in all possible combinations of states (state 
space) that the processes could collectively be in. Because 
the state space is exponential in the number of states, it be- 
comes untestable with a relatively small number of elements 
in the swarm. Traditionally, to get around the state-space ex- 
plosion problem, testers have artificially reduced the num- 
ber of states of the system and approximated the underly- 
ing software using models. Formal methods are proven ap- 
proaches for ensuring the correct operation of complex in- 
teracting systems. Once written, a formal specification can 
be used to prove properties of a system correct and check 
for particular types of errors (e.g., race conditions), and can 
be used as input to a model checker. Verifying emergent be- 
havior is one area that, unfortunately, most formal methods 
have not addressed well. 

The FAST (Formal Approaches to Swarm Technologies) 
project surveyed formal methods techniques to determine 
whether any would be suitable for verifying swarm-based 
systems and their emergent behavior [18, 19]. The project 
found that there are a number of formal methods that sup- 
port the specification of either concurrency or algorithms, 
but not both. Though there are a few formal methods that 
have been used to specify swarm-based systems, the project 
found only two formal approaches that were used to ana- 
lyze the emergent behavior of swarms. 

Weighted Synchronous Calculus of Communicat- 
ing Systems (WSCCS), a process algebra, was used 
by Tofts to model social insects [24], and by Sumpter, 
et al., to analyze the non-linear aspects of social in- 
sects [23]. X-Machines have been used to model cell bi- 
ology [13, 14], and with modifications, the X-Machines 
model has potential for specifying swarms. Simulation ap- 
proaches are being investigated to determine emergent 
behavior [12]. However, these approaches do not pre- 
dict emergent behavior from the model, but rather model 
the emergent behavior after the fact. 

The project has defined an integrated formal method, 
which is appropriate for the development of swarm-based 
systems [17]. Future work will concentrate on the applica- 
tion of the method to demonstrate its usefulness, and on the 
development of appropriate support tools. 

6. Conclusions 

A brief overview of swarm technologies has been pre- 
sented with emphasis on their relevance for potential fu- 
ture NASA missions. Swarm technologies hold promise for 
complex exploration and scientific observational missions 
that require capabilities that would be unavailable in mis- 
sions designed around single spacecraft. 


While swarm autonomy is clearly essential for missions 
where human control is not feasible (e.g., when communi- 
cations delays are too great or communications data rates 
are inadequate for effective remote control), autonomicity 
is essential for survival of individual spacecraft as well as 
the entire swarm, as a consequence of hostile space envi- 
ronments. 

NASA is pursuing further development of formal meth- 
ods techniques and tools that can be applied in the develop- 
ment of swarm-based systems, to help achieve confidence 
in their correctness. 
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